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5 A METHOD AND APPARATUS FOR ENABLING A COMPILER 

TO REDUCE CACHE MISSES BY PERFORMING PRE-FETCHES 
IN THE EVENT OF A CONTEXT SWITCH 

TECHNICAL FIELD OF THE INVENTION 

10 The present invention relates to compilers and, more particularly, to a 

compiler that generates pre-fetches that are performed in the event of context switch 
wherein the compiler returns from the context switch within a specified code region in 
cache memory to reduce cache misses. 

15 

BACKGROUND OF THE INVENTION 

In a computer system that is multi-threaded or multi-programmed, and that 
utilizes cache memory, upon each context switch made by the operating system, one 
thread or process is swapped out of cache and another is swapped into cache. When 

20 this occurs, the cache is generally re-populated only as the new thread or process 
references its data. Thus, after such a context switch, the new thread or process 
generally incurs a high frequency of cache misses. 

Furthermore, in a computer system that supports multiple outstanding cache 
misses, but which stalls on the first use of data being loaded, re-populating cache only 

25 as a new thread or process references its data may result in ineffectual use of all 
available bandwidth. 

SUMMARY OF THE INVENTION 

Accordingly, a need exists for a method and apparatus that enable the number 
30 of cache misses that typically occur in the event a context switch to be reduced or 
eliminated, thus enabling the bandwidth of the computer system to be efficiently 
utilized. The apparatus of the present invention comprises at least first logic, second 
logic and third logic that perform certain functions that enable cache misses to be 
reduced or eliminated. The first logic idenfifies at least a first prefetch region in a 
35 first memory element during compilation of a computer program by the computer. 

The second logic identifies critical memory references within the first prefetch region 
during compilafion. The critical memory references within the first prefetch region 
correspond to data that may be needed in cache memory if a context switch occurs . 
from a process or thread associated with the second context to a process or thread 
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